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Abstract 

Nonextensive entropies are divided into three classes, each of which is characterized by Shannon 
additivity and pseudoadditivity. One of the three classes has properties of both additivities. The 
remaining classes have only one property of the two additivities, respectively. An example of 
nonextensive entropy is shown concretely for each class. In particular, one class is found to consist 
of only the Tsallis entropy. More precisely, the Tsallis entropy is proved to be uniquely determined 
by only these two additivities. The present classification using these two distinct additivities reveals 
unique characteristics of the Tsallis entropy. 
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I. INTRODUCTION 



Shannon additivity and pseudoadditivity are characteristic properties of Tsallis entropy 
[IJ. Both of these additivities are nonextensive generalizations of the standard additivity in 
extensive systems. Although these properties appear to be similar in the sense that both 
additivities are given by the formulations of the entropy for the composite systems, A and 
B, they are actually different. When two systems, A and B, are mutually independent, 
in extensive systems, the Shannon additivity coincides with the pseudoadditivity, but in 
nonextensive systems, this coincidence generally does not hold. 

In the present paper, these two additivities are applied to characterization of three classes 
of nonextensive entropies. One of the three classes is characterized by satisfying both of 
these additivities, and the remaining two classes are characterized by satisfying only one or 
the other of the two additivities. An example of nonextensive entropy is shown concretely 
for each class. In addition, the Tsallis entropy is uniquely determined by only these two 
additivities. In the present paper, both the original Tsallis entropy and the normalized 
Tsallis entropy are discussed. 

II. SHANNON ADDITIVITY AND PSEUDOADDITIVITY OF THE ORIGINAL 
TSALLIS ENTROPY 

The original Tsallis entropy S q || is given by 

n 

S q (pi,---,Pn):= q l =\ (1) 

where q G R + . This nonextensive entropy is one-parameter generalization of the Shannon 
entropy in the sense that 

n 

lim£ 3 = Si := -^pdnpi. (2) 

^ i=l 

The Shannon additivity and the pseudoadditivity [jl] of the original Tsallis entropy are 
given by followings: 

(1) Shannon additivity: 

rrii n 

V* = 1,- • -,n,Vj = 1, • - -,mi : Va > 0, Pi = J2Pij, = 1, (3) 

j=i i=i 
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S q (p U , • ■ ■ ,PnmJ = S q (pi, ■■■,Pn) + J2Pi S l(—' ' ' ' ' — ) ■ ( 4 ) 

i=l \Pi Pi J 

(2) pseudoadditivity: 

S q (A, B) = S q (A) + S q (B) + (l-q) S q (A) S q (B) (5) 

where A and B are mutually independent finite event systems: 

(Ai •■■ A n \ (B l ■•■ B m \ 

A =( A J' B = \ B B I ' ^ 

\Pl ■■■ Pi) \Pf ■■■ PnJ 

These two additivities, Eqs.@ and @, can be proven in a straightforward manner using 
the definition given in Eq. ([!]). If the condition of independence given by Eq.@: 

Vz = 1, ■ • • ,n, Vj = 1, ■ ■ • ,m : p i j=Pi-p jj (7) 

is applied to the Shannon additivity given by Eq.([|), then the equation is simplified to 

S q (piu Pnm) = S q (pi, • • • , p n ) + \ S l(Pl> ' ' * > Pm) ■ (8) 

Here, we take m := raj for all % = 1, • ■ • , n. In terms of the following notations: 

Vi = 1, ■■■,n:p i :=pf, Vj = 1,- • ■ ,m : pj := pf , (9) 
5 ff (A) = 5,(pi, p n ), S q (B) = S q (p u p m ) (10) 

the obtained Shannon additivity, Eq.(|8|), is written as 

S q (A,B) = S q (A)+(±p^S q (B). (11) 

Note that in the case of q = 1 (extensive systems), the Shannon additivity finally reaches 

Si{A,B) = Si{A)+Si{B), (12) 

which coincides with the pseudoadditivity of Eq. (^) . In this way, when two systems, A and 
B, are mutually independent in the extensive systems, the Shannon additivity coincides 
with the pseudoadditivity 

However, under the above condition of independence, Eq.@, in nonextensive systems, 
these two additivities differ from each other in the sense that one additivity cannot be 
derived from the other. Comparing Eqs.([|) and (|TTD, these additivities do not coincide with 
each other. 

Therefore, the nonextensive entropies are divided into the following three classes: 



Class 1: Nonextensive entropy satisfying both additivities 

Class 2: Nonextensive entropy satisfying only the Shannon additivity 

Class 3: Nonextensive entropy satisfying only the pseudoadditivity 

Here, we need a condition that all nonextensive entropies should satisfy Eq.(Q). 

Examples of each class of nonextensive entropy will be shown concretely in order to reveal 
the difference between the two additivities. 

First, we uniquely derive the nonextensive entropy of Class 1 from only these two 
additivities, and the obtained entropy is found to coincide with the original Tsallis entropy. 

If two systems, A and B, are mutually independent in the nonextensive systems, then 
the two additivities are given by Eqs.(H) and (0), respectively. Eliminating S q (A, B) from 
both Eqs.(|) and (0) yields 

SV(A) + S£XB) + (l-q) S?\A) S q (B) = S?\A) + (£pl) S^(B) . (13) 

Therefore, the original Tsallis entropy, Eq.([|), is directly derived from Eq . (|l"3"D , as follows: 

n 

1 - E Pi 

S q [1) (A)= ( 14 ) 

Note that in this derivation only the Shannon additivity and pseudoadditivity are used. 
In other words, these two additivities uniquely determine the original Tsallis entropy. 

We must note here that our derivation is not consistent with the result reported in ||. 
As reported in [[|, the four conditions: (i) continuity, (ii) increasing monotonicity, (hi) 
pseudoadditivity, Eq.fl5|), and (iv) Shannon additivity, Eq.(f|), are given as axioms of the 
original Tsallis entropy and the uniqueness theorem thereof is proven. Note that the Shannon 
additivity in [[| is a special case of Eq.(^j). The generalization of the Shannon additivity in 

to Eq.(|]) is straightforward |L], In the present derivation, we uniquely determine the 
Tsallis entropy using only two axioms, (iii) and (iv) described above. Therefore, the above 
four conditions in [||] are redundant axioms of the Tsallis entropy. Thus, these two additivities 
become self-consistent axioms of the original Tsallis entropy, but complete parallelism does 
not exist between the Shannon-Khinchin axioms and the two additivities. 

Next, we consider the following example of the nonextensive entropy of Class 2, 
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where ip (g) is a differentiable function with respect to any g G R + , satisfying 

u ^M = 1) lim V? (g) = y ,(l) = 0, <p(q)?0 (q^l), and p(q)^q-l. (16) 
ag 9->i 

The difference in from that of the original Tsallis entropy, Eq. ([!]), is only the denomi- 
nator ip (q). Hence, the last condition of Eq.([R]) is required in order to belong to Class 2. 
The following equation for p (q) is an example satisfying all conditions of Eq. (|IED , 

,(^ (g - 1) f + 1) - (IT) 

We must confirm that the nonextensive entropy belongs to Class 2. Using l'Hospital's 
rule, we have 

n n 

l - EpI - E rfhip* 
S = ^ X) = l ™l ^Im = - Eft kj* = (18) 

f w dq l= l 



Thus, S^ 2 ) satisfies condition of Eq.(^). is found to have the property of the Shannon 
additivity, Eq.(ffl), as follows: 



Pi-- r - 



<p(q) 

V / 

= S^ 2) (p n ,---,p nmn ). 
However, does not satisfy the pseudoadditivity of Eq.(|5|). 

(A, B) ^ Sf^A) + 5f (fl) + (1 - g) Sf (A) 5f (B) (19) 

Thus, M 2 - 1 belongs to Class 2. 

Finally, we consider the nonextensive entropies of Class 3 in the following example: 

n -1 / 1 \ 71 i -1 1 n -1 

Erf rf" 1 -! Erf +9 _1 -Epf 

S< 3) (pi, • • • ,p„) := ^ s— r- = ^ „ *1 (20) 



[l-q)T,pT (1-9) Erf 

8=1 1=1 



Again, using l'Hospital's rule, we have 



E rf +9_ - 1 - E rf" (l - h) E rflnft + 4 E rf" Inft 
lim5f) = Hm^ ^ = hm V „ ' =1 ^ 

^ (l - 9) E rf" 1 ^ - E rf" 1 - (1 - g) £ E rf" 1 mp, 

i=l i=l y i=l 

n 

E Pi In Pi 

= t=1 — : = -^Pilnpi = 5i. (21) 

1 i=i 



Thus, Sfp satisfies condition of Eq.fl2|). can be easily found to satisfy the pseudoaddi- 
tivity of Eq.(|). 

S®(A, B) = S®(A) + S®{B) + {l-q) S®{A) S®(B) (22) 

However, the Shannon additivity of Eq.(^j) does not hold for S^. Accordingly, S q 3 ' belongs 
to Class 3. 



III. SHANNON ADDITIVITY AND PSEUDOADDITIVITY OF THE NORMAL- 
IZED TSALLIS ENTROPY 

The normalized Tsallis entropy S q was first introduced in || as one candidate of the 
generalized nonextensive entropies. The requirement for the normalized Tsallis entropy is 
presented based on the principle of the form invariance of Kullback-Leibler entropy || . or on 
that of the pseudoadditivity [|Hj], respectively. The normalized Tsallis entropy S q 0, |9], [10 



is given by 



n 

1- Epf 



S q ( P x,---,Pn)--= (23) 

(q ~ 1) £ p) 

where q G R + . This nonextensive entropy is also a one-parameter generalization of the 
Shannon entropy in the sense that 

n 

limS q = Si = -^pilnpi. (24) 

^ i=l 

The Shannon additivity and the pseudoadditivity [Q of the normalized Tsallis entropy are 
given by the followings: 

(1) Shannon additivity: 

■nii n 

Vi = 1, ■ • • , n, Vj = 1, ■ • • ,mi : p i5 > 0, p { = ^Pi j} ^pi = 1, (25) 

j=l i=l 

= (l>?U(pi, ■■■,Pn)+±tplA(^> ■■■^) (26) 



\i=l / i=l j=l 



Pi Pi 
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(2) pseudoadditivity: 

S q (A, B) = S q (A) + S q (B) + (q - 1) S q (A) S q (B) (27) 
where A and B are mutually independent finite event systems given by Eq.(H). 



The two additivities given by Eqs. fl26|) and (|27D are proven using the definition given in 
Eq. (p3|) . Note that the difference between the two Shannon additivities given by Eqs.(|]) 
and ( p6| ) is due to the normalization of the Tsallis entropy. The two Tsallis entropies S q and 
S q defined by Eqs.(^) and (|23p yield the following relation: 

S q (pi, ■ ■ ■ , Vn) = ( Yjp] \ Sg{Pi, Pn)- (28) 



Thus, substituting Eq. (pgj) into Eq.(^) yields the Shannon additivity of Eq.(|2T)|) for the 
normalized Tsallis entropy S q . Another difference in pseudoadditivity is that the coefficient 
"1 — q" in front of the cross term in the right-hand side of the pseudoadditivity of Eq.(|5|) is 
the inverse of ll q — 1" in Eq . (|27|) . The reason for this difference is the normalization of the 
original Tsallis entropy, which is discussed in detail in our paper JT0[ . 



Similar to the case of the original Tsallis entropy, the condition of independence given by 
Eq.(H) is applied to the Shannon additivity of Eq . (|26|) , which yields 



Y,P] S g (A, B) = S q (A) + £*? S q (B) . (29) 
Vj=i / \i=i / 

Here, we take m := m, for all i = 1, • • • ,n. Note that in the case of q = 1 (extensive 
systems) the Shannon additivity becomes the standard additivity of Eq.flT2]), which coin- 
cides with the pseudoadditivity of Eq.(^). In this way, when two systems, A and B, are 
mutually independent in the extensive systems, the Shannon additivity coincides with the 
pseudoadditivity. 

However, under the above condition of independence in the nonextensive systems, these 
two additivities differ from each other in the sense that one additivity cannot be derived 
from the other. Comparing Eqs.(p7|) and (p9|) , these additivities do not coincide with each 
other. 

Therefore, the normalized nonextensive entropies are divided into the following three 
classes: 

Class 1: Nonextensive entropies Sf^ satisfying both additivities 
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Class 2: Nonextensive entropies S^ 2 ' satisfying only the Shannon additivity 
Class 3: Nonextensive entropies satisfying only the pseudoadditivity 

Here, we need a condition that all nonextensive entropies should satisfy Eq.( 

Examples of each class of nonextensive entropy in each class will be shown concretely in 

order to reveal the difference between the two additivities. 

First, we uniquely derive the nonextensive entropy of Class 1 as in the previous 

section. If two systems, A and B, are mutually independent in the extensive systems, then 

the two additivities are given by Eqs.(^) and (|29|) , respectively. Eliminating S q (A, B) from 

both Eqs.fl27|) and (M) yields 



J>J {S q (A) + S q (B) + (q-l) S q (A) S q (B)} = S g (A) + £pj S q {B) . (30) 
Vi=i / V =1 / 

Therefore, the normalized Tsallis entropy of Eq.(p3|) is directly derived from Eq.(|30"D as 

follows: 

m 

i-Epf 



Si 1] (B) = i^— (31) 

(q ~ 1) E p) 
j'=i 

Note that in this derivation only the Shannon additivity and pseudoadditivity are used. 
In other words, these two additivities uniquely determine the normalized Tsallis entropy, 
similar to the case of the original Tsallis entropy. 

Next, we consider the following example of the nonextensive entropy of Class 2, 

n 

i- EpI 

Sf°(pi, •■■,»»):= ( 32 ) 

where ip (q) is a differentiable function with respect to any q G -R + , satisfying the conditions 
of Eq . (|i~6|) . Here, we must verify that the nonextensive entropy belongs to Class 2. 
Using l'Hospital's rule, we have 

n n 

1 - E - E Pi In Pi 

lim = lim ^ = lim n ^ = -J^Pi^Pi = Si- (33) 

^V(<z)£pj ^^EpI + ^Epfln^ 

3=1 ' 3=1 3=1 

Thus, S^ 2 - 1 satisfies the condition of Eq.(f24|). is found to have the property of the 

Shannon additivity Eq. (|26|) . 
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However, does not satisfy the pseudoadditivity of Eq. 

Sf (A, B) ^ §&> (A) + (5) + (g - 1) (A) 5f) (5) . (34) 

Thus, S^ 2 - 1 belongs to Class 2. 

Finally, we consider the nonextensive entropies of Class 3 in the following example: 

n g 2 +i , s n g 2 -2g+3 n g 2 +i 

Eft 2 (ft~ 9 -i) Eft 2 -Eft 2 
0(3) ._ i=i ^ _ - i=l i=1 

(? - i) E ft 2 (<z - i) E ft 2 

i=l i=l 

Again, using l'Hospital rule, we have 



Eft 2 -Eft 2 (q - 1) E ft 2 In Pi - g E ft 2 hip* 
lim £i 3) = lim ^ = lim ^_ ' 1 



(g-l)Eft 2 Eft 2 +?(?-!) Eft 2 lnpj 

i=i i=i j=i 



E ft In ft 



i=l 



1 



^ Pi In ft = Si (36) 



Thus, satisfies the condition of Eq.(pi|). In addition, is verified to have the property 
of pseudoadditivity of Eq. ( B7p . 



S®(A, B) = S^(A) + S®(B) + (q-l) S®{A) ^(B) (37) 

However, the Shannon additivity of Eq . (|26"D does not hold for Sjp. Accordingly, belongs 
to Class 3. 



IV. CONCLUSION 

We have shown that the nonextensive entropies can be divided into three classes which 
are characterized by the Shannon additivity and the pseudoadditivity. An example of each 
class is shown concretely and these two distinct additivities reveal the following peculiarities 
of the Tsallis entropy. 

First, the Tsallis entropy is uniquely determined by only these two additivities. Thus, 
these two additivities constitute the axioms of the Tsallis entropy. However, these axioms 
are not a naturally generalization of the Shannon-Khinchin axioms in extensive systems due 
to the lack of complete parallelism between them. 



Secondly, there exist nonextensive entropies satisfying only one of the two additivities. 
Accordingly, for the construction of the general axioms for the Tsallis entropy, unsatisfactory 
axioms consisting of these two additivities are observed. In other words, axioms that include 
both additivities are redundant. 
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